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Abstract 

the  intersections  of  the  nonnegative  orthant  in  En  with  pairs  of  com¬ 
plementary  orthogonal  subspaces  are  investigated*  Applications  to  linear 
inequalities  and  linear  programming  are  then  made  by  using  Fredholm's 
alternative  theorem. 

Introduction 

The  theory  of  linear  inequalities,  the  classic  reference  on  which  is 
[17]  ,  —  is  closely  related  to  the  theory  of  linear  equations.  — ^  This  relation 
is  the  subject  of  the  present  paper.  We  show  that  the  main  results  in  the 
theory  of  linear  inequalities  (in  finite  dimensional  vector  spaces  over  arbi¬ 
trary  ordered  fields)  follow  from  two  basic  facts:  (a)  Theorem  4  below  which 
is  an  elementary  property  of  the  intersections  of  the  nonnegative  orthant 
with  pairs  of  complementary  orthogonal  Bubspaces,  -  b)  Fredholm's 
"alternative  theorem."  —  Thus  new  proofs,  valid  in  arbitrary  ordered 
fields,  are  given  for  some  well-known  theorems  in  [  18]  [13]  [2]  and 

[3]  (corollaries  7,  8  and  9  below)  and  for  the  duality  theorem  of  linear 
5/  , 

programming-  (remark  10  below). 


\J  See  also  [l],  [8]  and  the  bibliography  in  [l6],  pp.  305-322. 

2/  E.g.,  [15]  and  [8],  §  16. 

_3 /  Studied  earlier  in  [  5]  [6]  and  [7], 

4/  E.G.,  [20],  p.  340, 

Si  A  relation  between  duality  and  orthogonality  was  recently  given  in  [  19 J • 
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0.  Notations 

The  notations  used  in  this  paper  are: 

{x:f(x)}  the  set  of  elements  x  for  which  f(x)  is  true 
{x}  the  set  consisting  of  x 

<j>  the  empty  set 

(,  C  respectively  element  and  set  containment 

U,  n,-  respectively  set  union,  intersection  and  difference 

T  an  arbitrary  ordered  field 

En  the  n-dimensional  vector  space  over  T-' 


the  zero  vector  in  E 


C{f .  :  i=l,  • . . ,  k}  =  {x  :x«En,  x  =  21  ar.f . ,  a.  c  'fc' ,  a .  >  0  ,  i=l, . . . ,  k} 
1  i=l  1  1  1  1  ‘ 

the  cone  spanned  by  the  vectors  {f . :  i=l, . . . ,  k}  in  En 

k  1 

int  C{f. :  i=l, . . . ,  k}  =  {x:x«En,  x=2  or.f.,  a tj- »  a.  >  0,  i=l,  ...,k} 
1  1=1  1  x  i  i 

the  interior  of  CtF  :  i=l,  ,,,,k} 
fodry  C{f. :  x*-l,  •  •  • ,  k}  —  C{f  ^ :  i=l,  •  • » ,  k}  *  int  C  {f^ »  x—1,  •  •  • ,  k} 
the  boundary  of  C{f . :  i=l, . . . ,  k} 

{e . :  i=l. . . .  ,  n}  a  fixed  orthonormal  base  in  En 

1  mtmtamm  -  ■  ■■ 1,1  ■  «  — » ■  -■  — —— 


E ,  =  C{e.  i  i=l»  •  •  • 

,  n}  the  nonnegative  orthant  in  En 

T  1 

For  x,  y  €  En  let: 

X 

IIV 

*< 

denote 

x  -  y  «  e“ 

x  >  y 

denote 

x  -  y  «  E"  -  {0} 

x  >  y 

denote 

_n 

x  -  y  «  mtE+ 

For  x,  y  «  En  let: 

n 

(x,  y) 

=  2  x.y. 
i=l 

denote  the  inner  product  of 

IlxB  = 

^(x,x)  the  norm  Of  x 

xly 

denote 

(x.y)=0 

3- 


F or  a  subspace  L  in  En  let: 

xiL  denote  xj.  y  for  all  y  c  L 

lA  -  {x:x«En,  xj.L}  ,  the  orthogonal  complement  of  L 
dim  L  :  the  dimension  of  _L 

x  +  L  =  {y :  y  «  En,  y  =  x  +  f,  f  «  L  }  a  translate  of  L 

2  T 

:  the  perpendicular  projection  on  1^  ,  i.  e.  P^=  =  P^  , 

L  =  {x:  x  c  En,  PLx  =  x} 

For  an  mxn  matrix  A  over  let: 

T 

A  denote  the  transpose  of  A 

N(A)  =  {x:x«En,  Ax=  0}  the  null  space  of  A 

T  n  nr*  TTX  T 

R(Aa)  =  {y:y*E  ,  y  =  A  v  for  some  veEm}  the  range  space  of  A 


1.  Theorem:  Let  P  be  a  perpendicular  projection  in  En  .  Then  the 
following  are  equivalent: 

(i)  Py  =  0  has  no  solution  y  >  0  . 

(ii)  Px  =  x  has  some  solution  x  >  0  . 

Proof:  (j)  =»  (ii) 

Proof  by  induction  on  rank  P  =  k  ,  k=0, 1, . . . ,  n  .  Since  both  (i)  and  (ii)  are 
false  for  k  =  0  ,  let  first  P  be  a  perpendicular  projection  of  rank  1.  R(P)  , 
the  subspace  of  all  solutions  of 

(1)  Px  =  x  x «  En  y 

is  of  dimension  1  and  therefore  representable  as: 

(2)  R(P)  =  (x:  x  =  ou  ,  a  t'p' ,  u  a  non-zero  solution  of  (1)} 


iy  E.g. ,  [12],  §41,  theorem  2, 
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Suppose  now  that  (ii)  is  false.  This  is  possible  only  in  two  (not  mutually 
exclusive)  cases,  where  {uj}^  are  the  coordinates  of  the  u  in  (2): 


Case  A:  u^  =  0  for  some  1 < i <n  . 


Case  B:  u^u^  <  0  for  some  1  <  k  ,  i  £  n  ,  i.  e. ,  some  two  components 
of  u  are  of  opposite  sign. 

In  each  case  consider  the  vector  v  ,  given  by  its  coordinates  {v.}?_j  as 
follows: 


Case  A 


:  v.  =  1  ,  v.  =  0  for  j  ^  i 
^  J  11 


Case  B:  v,=  1  ,  v  =  -  ,  u.  =  0  for  j  £  k,  l  . 

x  ■*  u.  j 


The  vector  v  satisfies 


v>  0 


lu  . 


Combining  (4)  and  (2)  we  conclude  that  v  J.  R(P)  and  therefore  satisfies  — ^ 
(5)  Pv  =  0 


But  (3)  and  (5)  imply  (i)  to  be  false,  and  thus  (i)  =>  (ii)  is  proved  for  k  =  1  . 
Suppose  (i)  =>  (ii)  is  true  for  perpendicular  projections  of  rank  k,  k=l, ....  n-1. 


\_t  E.g.,  [12],  p.  146. 

y  [l2j,  §  76,  theorem  1. 


Suppose  that  P  satisfied  (i)  .  But  Py  =  0  if  and  only  if  Q^y  =  0  =  Q^y  » 
hence  both  Q^.Q^  satisfy  (i)  .  By  the  induction  hypothesis  both  Q^.Q^ 
satisfy  (ii)  .  Thus  there  exist  vectors:  y  >  0  ,  z  >  0  such  that 

(8)  Qty  =  y  and  Q^z.  =  z  . 

The  vector  x  =  y  +  z  is  >  0  ,  and,  because  of  (6),  (7)  and  (8),  satisfies  (1). 
Thus  P  satisfies  (ii)  and  the  proof  of  (i)  =>  (ii)  is  completed. 

(ii)  =>  (i) 

If  Px  =  x  >  0  then  for  any  y  >  0  : 

0  <  (x.y)  =  (Px,  y)  =  (x,  Py) 

therefore  Py  £  0  .  — ^  -n 

ffl 

I  n 

2.  Corollary:  Let  L,L  be  complementary  orthogonal  subspaces  in  E  . 
Then  the  folio-wing  are  equivalent: 

(i)  LflEj  =  {0} 

(ii)  1^~  0  int  4  $ 

Proof:  Let  be  the  projection  P  in  theorem  1.  Statements  (i)  and  (ii) 

are  then  equivalent  to  the  corresponding  statements  in  theorem  1. 

f 

Remark:  A  stronger  result  is  given  in  theorem  4  below. 

3.  Corollary:  Let  L  be  a  subspace  in  En,  of  dimension:  dim  L  <  n  -  2  , 

such  that  L^E^  =  {0}  .  Then  L  is  contained  in  a  subspace  M  ,  with 
dim  M  =  dim  L  +  l  and  mOe^  =  {0}  . 


1  /  Only  the  symmetry  of  P  was  used  here. 
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Proof:  Let  dim  L  =  k,  0  <  k  <  n-2  ;  and  let  Xj,...,  *n_k  be  an  orthonormal 
basis  of  L^  with  XjC  L^flintEj  (by  corollary  2  this  is  always  possible). 

The  subspace  M  ={L  +  Xx2:\«7r}  contains  L  and  is  of 

dimension:  dim  M  =  dim  L  +  l  .  Since  M  J.  and  x^«  int  E+  it  follows 
that  M  0  E“  =  {6}  H 

Remark:  We  have  shown  that  any  subspace  L  of  E  ,  with  dimension  <  n  -  2, 

satisfying  L  0  e“  =  {9}  can  be  extended  to  a  subspace  M,  dim  M  =  dim  L  +  l  , 
and  the  same  property.  The  maximal  subspace  H^L  with  H  f)  E+  =  {®} 
is  a  hyperplane. 

4.  Theorem :  Let  L  be  a  subspace  of  En  .  Then  the  following  are 
equivalent: 

(i)  L  fl  E“  *  {0} 

(ii)  L"^  has  a  basis  in  int  E^ 

(iii)  For  every  x«En,  {x  +  L}  fl  E^  is  bounded,  maybe  empty. 

Proof:  The  part  (ii)  =>  (i)  follows  from  corollary  2.  Also  (iii)  =>  (i) 
is  obvious,  for  if  (i)  is  false  then  (iii)  is  false  with  x  =  0.  It  remains 
to  prove  that  (i)  ==>  (ii)  and  (i)  ==>  (iii)  . 

(i)  ==>  (ii) 

Proof  by  induction  on  dim  L  =  n-k,  k  =  0,1,  ...,n.  The  case  k  =  0  is 
trivial  and  the  case  k  =  l  is  proved  exactly  as  in  the  part:  (i)  =>  (ii)  of 
theorem  1.  Suppose  that  (i)  =>  (ii)  was  proved  for  subspaces  of  dimension: 
n  -  k  ,  and  let  L  be  a  subspace  of  dimension:  dim  L  =  n-k  -  1  ,  such  that 
L  f)  E”  =  {0}  . 
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By  corollary  3  LcM  with  dimM  =  n-k  and  MflE^=  {©}  •  By  the 
induction  hypothesis  M  has  a  basis  in  intE^  ,  say  {g^  :  i=l,...,k}  . 

Let  {L  :  i=l, ....  n-k-1}  be  an  orthonormal  basis  of  L  and  {L :  i=l, . . . ,  n-k} 
be  an  orthonormal  basis  of  M.  Consider  the  vector 

gk+l  =  £n-k+  Xgl 

where  X  e  'J-'  satisfied: 

x  x.  *fn-k,i* 

X  >  max  — - - 

*n-k,  i<  0  gl,  i 

The  vector  g^+j  ^s:  (a)  in  int  e”  ,  (b)  orthogonal  to  f.  ,  .  .  .  »fn_jc_j 

and  thus  in  lH"  ,  (c)  linearly  independent  of  g^, . . . , .  Therefore 
{ g ,  gk+1)  is  a  basis  of  L-*-  in  int  E^  . 


(i)  =>  (iii) 

Clearly  it  is  enough  to  consider  vectors  x«  L-*".  Let  u  be  any  vector 
in  L  with  II  u  11=1.  Since  LflE°  =  {©}  it  follows  that  u  must  have 
nonzero  coordinates  of  opposite  signs.  For  any  x«  L"^  ,  a  *  7~  »  the 
vector  x  +  aru  is  >6  only  if  the  scalar  a  is  bounded  by 


where  x.,  u.  are  the  coordinates  of  x,  u  respectively.  If  the  left  hand  side  * 

} 

in  (9)  exceeds  the  right  hand  side  then  {x+L}  f|E^  =  $  .  Otherwise  - 

x  +  oru  c  {x+L}f|E+  only  if  |  x+aru  ||  =  (x,  x)  +  ar  <«,  by  (9),  which  completes 
the  proof. 

B 
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5.  Corollary:  Let  L  be  a  subspace  of  En  of  dimension  k,  k=l, , , ,  n  . 
Then  the  following  are  equivalent: 

(i)  LnbdryEj  =  C{e1,...,ep>  ,  l<p<k. 

(ii)  jJ-  has  a  basis  in  intC{e  ,e  }  . 

p+i  n 


Proof: 

(i)  =>  (ii) 

Consider  E*1,  the  space  spanned  by  {e^, . . . ,  ep}  as  a  subspace  of  En  ,  and 
the  quotient  space  of  En  modulo  E^:  En/E^  .  From  (i)  it  follows  that 
E^C  L  .  Hence  in  En/E^  the  subspace  L/E^  satisfies  (i)  of  theorem  4. 
Therefore  L^/E**  has  a  basis  in  int(E^/E^)  =  int  C{ep+j, . . . ,  en)  . 

But  L^/E^  =  L"*’  and  (ii)  is  established. 


(ii)  =>  (i) 

From  (ii)  it  follows  that  C{e^, . . . , ep}  C  L  and  consequently  (i)  . 
Remarks: 


(a)  If  p  =  k  then  (ii)  can  be  rewritten  as 

(ii’)  L^HEj  =  C{ep+1 . ej 

(b)  If  dim  L  <  n  -  2  it  can  be  shown  as  in  corollary  3  that  L  is  contained 
in  a  subspace  M  with  dim  M=dim  L  +  l  and  Mfl  bdry  e”  =  C{ej, .  *  . , ep}  . 
The  maximal  subspace  H  with  H3L  and  HflbdryE*1  =  C{e,,. . .  ,e  }  is 

+  1  p 

a  hyperplane,  e.g. ,  [10],  p.  316,  theorem  33  (2)  . 


6.  Corollary:  Let  L,  L'L  be  any  pair  of  complementary  orthogonal  sub¬ 
spaces  in  En.  Then  there  is  a  vector  x  in  intE^  such  that  x  =  y+z  , 
y  <  Lfl  E“  ,  z  «  Lx  fl  E“  . 
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Proof: 

Since  the  case:  L  =  En,  LT*"=  {0}  is  trivial,  let  dim  L  =  1, .  ..,n-l  ,  Now 
there  are  three  mutually  exclusive  cases: 

(i)  L(1e“  =  {6} 

(ii)  Lnbdry  E“  =  C{elf...,ep}  ,  1  <  p  <  dim  L  and  Lf)intEj  =  <|> 

(iii)  LflintE^  . 

In  case  (i)  we  use  corollary  2  and  choose  x  as  a  vector  in  lJ~  fl  int  E^  . 
Thus  x  =  z  and  y  =  0  . 

In  case  (ii),  corollary  5  is  used  to  construct  x  as  x  =  y  +  z  wh?re 
z  «  fl  int{ep+j, . . . ,  en}+  and  y  is  any  vector  in  int  C{ej, . . .  ,  ep}  . 
remark  (a)  following  corollary  5,  if  p  =  dim  L  then  any  vector  x  in 
can  be  so  represented. 

Case  (iii)  is,  by  corollary  2,  case  (i)  with  L,  lA  permuted. 

7.  Corollary:  (Tucker  [  18])  Let  A  beany  mxn  matrix  over  7~ 
the  following  system  of  equations  and  inequalities 

Ax  =  0  ATu  >  0 

x  >  0 

has  solutions  x°,  u°  satisfying 
A*" u°  +  x°  >  0  . 


By 

intE 


.  Then 


+  tJ 
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T 

Proof:  Follows  immediately  from  corollary  6,  by  letting  L  =  R(A  )  and 

using  Fredholm's  alternative  theorem  ([20],  p.  340)  which  for  a  linear 
n  m  T 

operator  A:  E  — E  can  be  stated  as:  R(A  )  and  N(A)  are  complementary 

orthogonal  subspaces  in  En  ,  e.g. ,  [l2],§49.  _ 

H 

Remark:  This  corollary  is  fundamental  in  the  theories  of  linear  inequalities 

and  linear  programming,  e.  g. ,  [18],  We  proved  it  here  as  a  consequence  of 
two  facts: 

(a)  Corollary  6  which  states  a  simple  property  of  the  intersections  of 
E+  with  arbitrary  pairs  of  complementary  orthoronal  subspaces. 

(b)  Fredholm's  alternative  theorem 

En=R(AT)  ©  N(A) 

which  is  basic  to  the  theory  of  linear  equations. 

The  abundance  of  theorems  (e.g. ,  the  Minkowski-Farkas- Weyl  theorems  [2] 
and  their  consequences)  which  follow  corollary  7,  e.g. ,  [  18]  emphasizes  the 
merits  of  a  unified  treatment  of  linear  inequalities  and  equations,  e.  g. ,  [  15 ]  . 

8.  Corollary  (Jackson  [13],  Charnes- Cooper  [  2]):  Let  A  be  any  mxn 

matrix  over  p  .  Then  the  following  are  equivalent: 

(i)  Ax  =  8  has  no  solution  x  >  0  . 

T 

(ii)  A  u  >  6  has  solutions. 

(iii)  For  any  bsE1*1  the  set  (x  :  x«En,  Ax  =  b,  x  >  0}  is  bounded, 
maybe  empty. 

Proof:  Setting,  by  Fredholm's  alternative  theorem,  L  =  N(A)  and  L'L=R(AT) 

it  follows  that  statements  (i),  (ii)  and  (iii)  are  equivalent  to  the  corresponding 
statements  in  theorem  4 . 

G 
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Remark  :  In  the  real  case  this  theorem  was  proved  by  Jackson  [  13 J  .  The 

part  (i)  — >(iii)  is  close  to  the  "opposite  sign  theorem"  of  Char nes- Cooper 
[2],  [3],  which  states,  more  precisely*  that  (i)  above  is  equivalent  to: 

(iv)  The  set 

{x:xcEn,  Ax  =  b »  x  >  0} 
is  spanned  by  its  extreme  points. 

Property  (iv),  see  [4],  is  not  restricted  to  bounded  sets  when  x  is  in  an 
infinite  dimensional  vector  space. 

9.  Corollary  (Tucker  C 18] ) :  Let  K  be  a  skew  symmetric  matrix  over  T~  .  — ^ 
Then  the  system  of  inequalities 

Kw  >0  w  >  0 

has  a  solution  w°  such  that 

(10)  Kw°  +  w°  >  0  . 

Proof:  Consider  the  system  of  equations  and  inequalities 

(J*  kt)  (*)  =  e  (').*• 

(“)  S0 

by  corollary  7  this  system  has  solutions  |x\  and  u°  such  that 


Combining  (11)  and  the  fact  that  x°  =  -KTy°  =  Ky°  ,  it  follows  that  w°  =  y°  +  u° 
satisfies  (10)  . 


1/  Le., 


K  =  -KT 
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10.  Remark;  Corollary  9  vai  used  to  prove  the  duality  theorem  of  linear 
programming,  e.  g. ,  [9]  and  [ll]  .  We  conclude  this  paper  by  outlining  an 
alternative  proof  which,  like  our  other  results  above,  rests  upon  the 
"Fredholm  alternative"  theorem. 

Consider  the  pair  of  dual  problems 

T  T 

maximize  c  x  minimize  w  b 

T  T 

Ax  <  b  w  A  >  c 

x  >  6  w  >  6 

where  A  is  an  mxn  matrix  over  J-  ,  b  c  Em  and  c  «  En  . 


To  these  problems  there  corresponds  the  (m  +  1)  x  (m  +  n  +  1)  matrix: 


where  t  is  in 


T  • 


For  any  given  value  of  t  we  consider  the  subspaces 


T 

N(Bt)  and  R(Bt )  --which  are  complementary  orthogonal  by  Fredholm's 
theorem— and  their  intersections  with  E^+n+*  : 


N(Bt)nE^+ntl  =  |  |xj 


art  -  c*x  =  0  1 
-arb  +  Ax  +  y  =  0  ? 
«>0,  x,y  >  0  J 


r 

1  pt  -  b  w  \ 

pt  -  w  b  >  <n 

R(B’F)nE™+n+1  =  J 

l-pc  +  Aw 

:  -pcT+  wTA  >  0TJ 

1 

\  w  j 

w  >  0  J 

The  duality  theorem  of  linear  programming  (as  well  as  the  "complementary 
slackness"  property,  [ll]  ,  which  is  the  statement  that  R(B^nE™+n+^  and 
N(  Bt)HE^a+n+^are  orthogonal  sets  follows  now  by  considering  the  above  inter¬ 
sections;  the  keys  to  the  whole  situation  being  the  vanishing  of  the  scalars 
a,p  and  the  value  of  t.  The  details  are  left  to  the  reader. 

1_/  A  similar  relation  between  duality  and  orthogonality  was  studied  by 
Tucker  in  [19]  . 
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